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ABSTRACT 

This booklet comprises excerpts from the proceedings 
of a conference held in Maryland to explore the related themes of 
accountability and the evaluation of compensatory education. 
Participants at the conference were administrators, teachers, aides, 
and parents who met in small-group work sessions. The conference is 
judged to have succeeded in stimulating exchanges of ideas and 
self-examination. In addition, several key concepts are considered to 
have merged as continuous themes, which should be, it is held, taken 
into consideration in the design of any ESEA Title I program of 
compensatory education: (1) basic academic skills, with an emphasis 

on reading and language arts, must be the focus of Title I programs: 
(2) the trend in compensatory education programs for the 
disadvantaged is toward prevention of problems rather than 
remediation of long-entrenched problems: (3) a comprehensive 
assessment of the needs of the disadvantaged is essential in 
preparing Title I projects; (4) the >*ey to meaningful evaluation is 
in the statement of the projects objectives; and (5) evaluation 
instruments to be used to measure the effects of the project should 
be expressly and specifically related to the stated objectives and 
activities of a project. [Because of the poor contrast between the 
type and the colored pages of the original document, several pages 
will not be clearly legible in microfilm and hard copy reproduction. 3 
(Author/RJ) 
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; Public education is receiving more money today 
tha.i ever before. At the same time, the public is 
? discontented because the schools do not seem to 
be producing results commensurate with the 
money being invested in them. Educators are 
being held accountable for the gap. 

Too often we, as educators, measure success in 
terms of what makes up a program rather than 
what emerge:- as the end result. The merit of a 
program is determined by the number of aides 
employed, the reduced size of clashes, or the use 
I of more sophisticated equipment rather than by 
how much the students actually learn and acVeve. 

Too often we establish goafs and objectives for 
a project only to lose sight of them once the 
program of Instruction is implemented. 

Too often we design educational programs to 
; satisfy the professional cr personal needs of edu- 
cators. Yet, educator, are and must be held ac- 
countable for establishing and implementing 
programs that meet the needs of each child and 
the needs and expectations of his family and 
community. 

Too often "cultural enrichment" is stressed at 
the expense of academic achievement, learning 
to get along with other people and to develop a 
sense of dignity and respect for one's self and for 
others /$ a legitimate part of education. However, 
parents and legislators know that many children 
are not learning how to read. And, they are blam- 
ing the schools. As a result, more and more ma- 
chines and privately contracted educational engi- 
neer are being employed to "teach" children. 

Ecucators can no longer evade these critical 
implications of accountability. 



V 




JAMES A. SENSENBAUGH 
State Superintendent of Schools 





1970 marked the fifth year for ESEA Title I pro- 
grams in Maryland. In observance of this mile- 
stone, the Maryland State Department of Educa- 
tion, Division of Compensatory, Urban, and 
Supplementary Programs, held a conference in 
February to explore the related themes of ac- 
countability and the evaluation of compensatory 
education. 



Each local subdivision was invited to send a 
team of Title I administrators, teachers, aides, and 
parents to the two-and-a-half day conference at 
the University of Maryland. Following ejch pres- 
entation by a speaker, participants met «n small 
group work sessions to discuss further the topics 
of accountability, project objectives, needs assess- 
ment, testing, the collection of baseline data, and 
project evaluation. This booklet contains high- 
lights of some of the ideas, concepts, and areas of 
concern that emerged during the conference. 

The conference was an important first step in 
making those involved In Title I programs aware 
of the need for and means of insuring accounta- 
bility in compensatory education. Hopefully, from 
this awareness will come even more effective and 
meaningful programs for the State's educationally 
disadvantaged. 






PERCY V, WILLIAMS 



Assistant State Superintendent 
Division of Compensatory, Urban, 
and Supplementary Programs 
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A Word On Accountability 



Dr. Quentin L. Earhart, Deputy State Superin- 
tendent of Schools, requested at the opening 
session of the conference that the participants' 
first act be to write down in large, clear letters 
one word: ACCOUNTABILITY. By the end of the 
conference, "accountability" was echoing in 
everyone's ears. The topic was timely because on 
March 3, 1970, In an address on educational re- 
form, President Nixon also stressed the theme of 
accountability: 



School administrators and school teachers alike 
are responsible for their performance, and it is 
in their interest as well as in the interest of their 
pupils that they be held accountable. Success 
should be measured not by some fixed national 
norm but rather by the results achieved in rela- 
tion to the actu ii situation of the particular 
school a r d the particular set of pupils. For 
years the fear of national standards has been 
one of the bugaboos of education. . . . The prob- 
lem is that in opposing some mythical threat 
of national standards, what we have too often 
been doing is avoiding accountability for our 
own local performance. We have, as a N.tlion, 
too long avoided thinking of the productivity 
of schools. . . . Ironic though it is, the avoid- 
ance of accountability is the single most serious 
threat to a continued, and even more pluralis- 
tic educational system. Unless the local com- 
munity can obtain dependable measures of just 
how well its school system Is performing for its 
children, the demand for national standards 
will become even greater. . . , 
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In the same message thvi President pointed out 
that: 



The old answer [to the question of what makes 
a good school] was a school that maintained 
high standards of plant and equipment, that 
had a reasonable number of children per class- 
room, whose teachc-rs had $ood college and 
often graduate training, thav kept up to date 
with new curriculum developments and was 
alert to new techniques in instruction. This was 
3 fair enough definition so long as it was as- 
sumed that there was a direct connection be- 
tween these school characteristics and the 
actual amount of learning that lanes place in a 
school. Years of educational research, culmi- 
nating in the Equal Educational Opportunity 
Survey of 1966, have, however, demonstrated 
that this direct, uncomplicated relationship 
does not exist. 



As Dr. James A. Sensenbaugh, State Superintend- 
ent of Schools, observed at the conference, par- 
ents / legislators, the press, and the general public 
are expecting visible evidence of student achieve- 
ment in return for the great sums of money cur- 
rently being invested in public education. And, 
these groups are holding educators responsible 
for what students achieve — or do not achieve — 
in school. This Is the essence of accountability 
and the challenge confronting all who are In- 
volved In programs of compensatory education. 
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Accountability For 
Compensatory Education 



The folfowing are excerpts from the keynote 
address given by Dr, Wilson C Riles, Deputy 
State Superintendent of the California State De- 
partment of Education. 



A NEWDEFINlTION OF EQUAL 
EDUCATIONAL OPPORTUNITY 

"With ESEA Title I and compensatory education 
came a new definition of equal educational op- 
portunity. We came to realize that equal ecfuca- 
tional opportunity does not mean the same edu- 
cational program for each child, but an educa- 
tional program geared peculiarly to the needs of 
each individual child — a program designed to 
develop to the maximum the potential of each 
youngster." 



THE NATURE OF COMPENSATORY EDUCATION 

"To some people, any addition to the regular 
school program, no matter how small or insignifi- 
cant, is called a compensatory education. The 
resources put into the effort may be as little as 
$50 per child, and it's called compensatory edu- 
cation The average for California's Title I 

programs last year was abc ut $190 per child. The 
most successful programs generally involved 
more than that/' 

"Compensatory education does not consist 
merely of reducing class size. ... If you do the 
same thing with 20 that you do with 40, it's not 
going to make any difference." 

"Compensatory education does not consist 
merely of remedial reading using the same in- 
structional techniques that have failed In the past. 
A good compensatory program must take Into 



account all of the factors that are impeding the 

child's learning process It must consider the 

child's health problems, his attitudes, his self- 
image and his lack of verbal ski lls, all of which 
may be impeding his learning to read. It must 
take into account the negative effects of segrega- 
tion, both racial and economic. . . ." 

"Each child in a compensatory education program 
should continue to receive the services he needs 
until he is able to maintain progress without addi- 
tional help." 



TEACHERS AND COMPENSATORY EDUCATION 

"Only if we have teachers who are understanding, 
who sense the professional challenge of working 
in poverty areas, and most of all, who care, will 
we succeed in our goal to provide the disad- 
vantaged child with the same benefits available 
to *11 other children. . . ." 



'There is ph nty of evidence to show that a stu- 
dent's achievement level will tend to confirm the 
teacher's preconceived judgment of that student's 
capabilities. . . . Much of our problem In the past 
has been that educators really didn't expect chil- 
dren in poverty neighborhoods to succeed. . . . 



"The task Is not to teach down to the young- 
sters but to give them the experiences and the 
special help they need to achieve up to the high 
standards we set." 




COMMUNITY AND PARENT INVOLVEMENT 

"We cannot work in a vacuum apart from the 
community. We cannct be successful if the com- 
munity does not have the faintest idea of what 
we are trying to do. . . . We cannot hope to reach 
the children without invoking the parents in the 

process We need not feel that we have to 

do the total job. We must give parents the oppor- 
tunity to work with us." 



EVALUATION OF COMPENSATORY EDUCATION 

"The evaluation report not only shows where we 
were but also the direction we should take. . . . 
Our job has become one of weeding out the 
ineffective practices and enlarging upon the effec- 
tive ones. Trial and error was fine for the frstyear 
but not for this year and for next year. Changes in 
compensatory education have to be based upon 
the evaluation results."' 



ACCOUNTABILITY AND THE POLITICS 
OF COMPENSATORY EDUCATION 

"I have appeared before many legislative com- 
mittees in Washington and in California and 
I can tell you that they are interested in only one 
thing: the effects of compensatory education on 

achievement We know, as educators, that 

there are a lot of other in*puts and we should see 
that those that affect achievement are put In. But 
let us be political enough to know that legislators 
and the public are not going to look at all of those 

other things They are going to look at 

ach/evement, so let's be sure that we don't let 
that fall by the wayside. 



"The public is demanding that educators be 
held accountable for providing measurable re- 
sults in student performance . . . . Some people 
say that the standardized achievement test has not 
really reflected what children have learned, that 
the test is 'culturally biased.' . . . But I tell you 
this: standardized tests do reflect the skills and 
achievement level that are looked for by the col- 
leges and the job market . . . Unless we plan to 
create a separate college and a new job market 
for disadvantaged children, our responsibility is to 
provide them with the skills they need to com- 
pete in the existing ones." 

. . We wouldn't have a problem with the Con- 
gress or the President vetoing Title I money if the 
parents knew that Title I was being successful 

with their children When parents go and 

knock on the door, then Congressmen listen." 

. . It's tough for you in your local district to 
concentrate on just a few youngsters, . . . but we 
must say that that is all we could do, and if 1 ve 
show results (and the only way to show results is 
to have an evaluation), then we can go to the 
decision-makers and say, 'If you give us these 
kinds of resources, this is the kind of job we can 
do.' We must not lose sight of our goal, wl kh Is 
to raise the achievement level of disadvantaged 
youngsters." 






Clear, Simple, Measurable Objectives j 

For Accountability j 

I 



As Dr. Riles pointed out, a project evaluation 
should show what has been accomplished (stu- 
dent achievement); what activities have been 
effective (or ineffective) in stimulating achieve- 
ment; and what directions subsequent programs 
should take to insure continuing and expanding 
effectiveness. But how meaningful, how useful, 
and how reliable an evaluation will be depend on 
how carefully tne program is designed and im- 
plemented. Put another way, an evaluation is the 
proverbial cart before which must come a sturdy 
horse — namely, the program itself. A horse is a 
complex animal of many parts, all of them essen- 
tial for him to pull the cart. Similarly, a program 
of compensatory education consists of many in- 
terrelated components, all of which must be 
taken into consideration if the program is to be 
effective. 

One of the most important components of a 
program, without which no meaningful evalu- 
ation can be made, is the program's objectives. 

A limited number of clear, simple, measurable 
objectives are to a program of compensatory 
education what muscle and blood are to a horse. 
At the conference Dr. Charles H. Hammer, Edu- 
cational Program Specialist with the United States 
Office of Education, presented some ideas on 
stating project objectives 



NEEDS ASSESSMENT 

"There is a reasonably orderly progression in 
project planning. It begins with needs assess- 
ment if you don't begin with a needs assess- 

ment, you have no basis for formulating an ob- 
jective or deciding what kinds of services to 
provide. . . , 

"In order to insure the most relevant set of 
services, the needs assessment should be as com- 
prehensive as possible, covering academic per- 
formances, physical and health characteristics, 
and psychological or emotional status." 




OBJECTIVES i 

"The state ment of objectives should parallel the J 
statement of needs in structure and in detail. The 
more specificity that can be put into a needs 
assessment and statement of objectives, the more 
specificity can be put into a plan of services to 
meet those needs and reach those objectives. 

And this should greatly improve the chances of 
providing the most relevant and appropriate 
services." 

Dr. Hammer described objectives as having 
three components and three characteristics, as 
seen in the accompanying diagram. 

Measurably is the first characteristic of a well* 
conceived objective. An objective should be 
based on a stated assessed need that can be 
c/escr/bed in measurable terms. Dr. Hammer 
listed standardized achievement tests and also 
diagnostic tests in the areas of basic skills, psy- 
chological or emotional adjustment, and physical 
health as some of the tools tnat can be used lo 
measure both student needs and expected 
outcomes. 

The second characteristic of a carefully stated 
objective is ", . . the relevance of the objective 
to the assessed needs and the type of treatment 
or services provided. ... If, according to your 
needs assessr lent, children need some kind of 
remediation reading, you don't provide them 
with just a hot lunch and measure their progress 
in emotional stability." 







The third characteristic of an objective is 
rea/rsm: ''The forecast of gains or the expected 
amount of progress made toward your terminal 
behavior status — your postmeasure — should be 
realistic. If the child has been falling farther and 
farther below the norm with the passage of time, 
it's not realistic to expect to be able to bring him 
back to grade norm within six or seven or eight 
or nine months." 



SUBOBJECTIVES 



in formulating objectives, . . we have to look 

at the whole array of needs and sub-needs 

These data tell us not only how deficient a child 
or group of children might be in an overall aca- 
demic basic skill behavior like reading or reading 
comprehension, but they also tell us how de- 
ficient he is with respect to the prerequisite skilfs 

for reading or reading comprehension We 

are in a position to state not merely an overall 
objective, such as a gain score in reading, but a 
series of subobjectives as well, relating to pre- 
requisite skills and to nonacademic skills " 



THE RELATIONSHIP BETWEEN 
OBJECTIVES AND EVALUATION 



. . if you: objectives are properly stated and ir: 
measurable terms, you have in essence been 
spelling out •he outline of your evaluation plan. 
Your evaluation essentially is then designed to tell 
you how close you have come to accomplishing 
each of your major and subobjectives/' 
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1 Each project objective should state specifically 
the duration of project services {time lapse) and 
the desired outcome or point to be reached by 
students at the conclusion of the project 
(terminal behavior status}. 

2 Project objectives are derived from the assessed 



needs of the students who are to participate In 
the project {original behavior status). 

3 Each objective and subobjective in a project 
should be scrutinized to determine if what it 
proposes is (a) measurable; (b) relevant; and 
{c) realistic. 





Baseline Data And Instruments 
For Pre-And Posttesting 



Cains in student achievement, or a lack of them, 
are what educators are being held accountable 
for. The public, parents, legislators, students, and 
educators themselves use test results as the most 
convenient index for determining how much 
students have achieved. By extension, these test 
results become the principal criteria for judging a 
program's success or failure. 

Dr. Roger Williams, Chairman of the Depart* 
ment of Psychology at Morgan State College in 
Baltimore, discussed the relationships between 
tests and compensatory education projects. He 
also explored some types of baseline data that are 
useful in the assessment of students' needs and 
important in defining the areas of gain for which 
educators are being held accountable. 

SOURCES OF BASELINE DATA 

"Data provided by scores must be looked at from 
the standpoint of the baselines from which they 
extend . . We are concerned with age, with sex, 
with the level of education, and with the location 
and identity of the program of the schools where 
people are. We are concerned with subgroups 
in certain communities. We are concerned with 
neigh be i hoods. We are even concerned with 
measurements of the level of participation in 
neighborhood activities. All of these provide 
baselines from which it is possible for us to move 
forward. . ; . Baseline is simply a device which 
says, *We a re here/.lt is a device which has a 
particular and a peculiar relationship to objectives 
in saying that when we desire to accomplish a 
certain objective, we shall measure or evaluate the 
success in accomplishing it from this point 

' "Baseline data may be obtained by comparing 
the performance at a given time of disadvantaged 



children against that of advantaged children, for 
we need to know the magnitude of the depriva- 
tions which have to be overcome. . . 

. . we need to understand how our teachers 
compare with advantaged teachers and how our 
schools compare with advantaged schools." 

"We may obtain baseline data by comparing 
disadvantaged children with other disadvantaged 
children, for we need to know the relative 
deprivation they express in terms of others who 
may or may not be similarly disadvantaged." 

". . . baseline data may be obtained by comparing 
the children with their previous performances in 
ways which make . . . them their own controls." 
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ON TEST INSTRUMENTS 
AND TESTING 

"The pre- and posttest concept ... is useful as an 
instrument in just about any type of project, , . . . 
but especially so in Title I. But the worth of this 
technique is based on the efficiency of test 
measurements taken. 

" when we speak of test measurements, we are 
not necessarily confining ourselves to pencil and 
paper tests. . . . While these cannot be dismissed, 
they are not always appropriate. But a test is 
always appropriate. If we have no tests, we have 
no knowledge. ... My use of the term 'test 
measurements' . . . includes any procedures by 
which it is possible for us to have any assurances 
that our pupils are changing their behavior as a 
consequence of the efforts we put forth. 

" There is still room for developing creative 
approaches to the measurement of achievement 
and ability. Baseline data would become even 



more meaningful when determined by fresh and 
relevant devices and techniques rather than by the 
often stale and often-used standardized test 
samples. 

"for example, more use must be made of the 
everyday behavior of the child as evidence of his 
abilities and competencies for coping with his 

school and out-of-school environment 1am 

trying to make a plea for a level of observation in 
which it is possible to utilize observed behaviors 
in the preparation and construction of the 
instruments which will later be used to measure 
such behavior. ... 1 fear that in many instances we 
have lost this rich source of information and 
insight. These measurements must be used 
repeatedly and in cyclical fashion, just as must be 
the case with more regular instruments/' 
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USING STANDARDIZED TESTS 

"Literature on tests, the books put out by test 
publishers, are sometimes extremely misleading. 

... It is wise to pay as much attention to what is 
not said as to what is said." 

. . The basic problem in accountability is not 
simply testing but interpreting data . . . Interpreta- 
tion is fundamental, for it is not the scores 
produced by the children that are significant but 
what lies behind the scores/' 

"Relevant standardization will produce reliable 
differentiation within the range of scores earned 
by disadvantaged groups. But in many of the 
instances when tests are otherwise acceptable, 
standardization scores have been chosen in ways 
which do not make the norms applicable to the 

subgroups to which they are being applied 

You, because you have to make proper compari- 
sons at the proper time may have to accept this 

responsibility of renorming tests Every effort 

must be made to insist that the evaluative thrusts 
aimed at a prefect be both competent and 
relevant to the groups with which the project has 
been dealing /* 
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Educational Significance 
And Terminal Evaluation 



ERiC 



Dr. George T. Gabriel, Director of Educational 
Research for the Baltimore County Board of Edu- 
cation, suggested that the results of a project may 
be viev/ed in term ' ‘heir statistical significance, 
their educational s. c '^ance, and their ic/evant 
significance. Once again underscoring the in- 
separability of the various phases of project de- 
sign, he noted that project objectives must have 
statistical, educational, and relevant significance 
if project results are to be likewise significant. 



STATISTICAL SIGNIFICANCE 



. . We seem to have become satisfied with seek- 
ing statistical significance, wherein the resuts of 
posttests are significantly different from perform- 
ance on pretests or where an experimental group 
performs with significant difference from a con- 
trol group. . . . If something is said to be 'statisti- 
cally significant/ we tend automatically to attach 
an importance to it. . . . The complement is also 
true: when a study reports results as not being 
statistically significant, we tend to shrug off the 
project. . . . It's important that statistical signifi- 
cance be attained, but beyond statistical signifi- 
cance, additional questions have to be asked, . . . 
whether something is really educationally 
significant" 



’ EDUCATIONAL SIGNIFICANCE 



. . Is not necessarily synonymous with statistical 
significance." 



’■ To illustrate the difference, Dr. Gabriel cited a 
case In which posttest scores on * test admin- 
istered at the conclusion of a summer program to 
a group of preschool children Indicated a statisti- 
cally significant change from the pretest scores. 
Specifically, there was an overall Increase of 
seven raw score points between the pre- and 
posttests and an overall change from a thirteenth 
percentile rank at the beginning of the su^ i>er 
to a seventeenth percentile rank at the end of the 
summer. Statistical analysts Indicated that these 



gains were significant. However, Dr. Gabriel ques- 
tioned whether or not the magnitude of gain, or 
the low scores even after gains were mads, could 
be considered "educat onally significant." 



RELEVANT SIGNIFICANCE 

". . . Has participation really been relevant for the 
young people that have been exposed to the 
project?" 



Dr. Gabriel cited the Westinghou$e*Ohio Uni- 
versity study of preschool programs ("The Impact 
of Head Start: An Evaluation of the Effects of 
Head Start on Children's Cognitive and Affective 
Development," June 1969) as one that posed the 
question of "relevant significance." The effects of 
the preschool programs, at the time the children 
left the program, were appraised in terms of their 
statistical and educational significance. In addi- 
tion, studies were made to determine whether or 
not the programs had had, in effect, any real edu- 
cational value for the preschool children by the 
time they reached the end of grades one, two, or 
three. The results of the latter studies were used 
to indicate the "relevant significance" of the 
programs, and in the case of the Westinghouse 
Learning Corporation study of Head Start, the 
programs were found to have little relevant sig- 
nificance. That Is, children who had participated 
and shown statistically and even educationally 
significant gains in the preschool programs did 
not necessarily carry over these gains Into the 
regular >chool program. As a result, the relevant 
significance of Head Start was cast into con- 
siderable doubt 







RELEVANT SIGNIFICANCE AND 
TERMINAL EVALUATION 

"Terminal evaluation has to do with the end of 

the project But, when do projects end? . . . 

The State educational agency and the local edu- 
cational agency have found themselves in a bind 
of having to make a 'terminal evaluation' immedi- 
ately after a project ends, on a *"?ar-by-year basis, 
due largely to legal requirements and guideline 
regulations. This fits the description of terminal 
evaluation if you define it in a narrow sense, and 
in terms of a project's statistical rnd educational 
significance. . . 

however . . . 

"Other agencies are superimposing diffe/ent 
types of evaluative procedures on projects after 
they have 'terminated.' . . . The objectives that are 
being appraised by some of these other agencies 
are very different from the objectives that were 
originally established and stated when the pro- 
gram was Initially Implemented The ultimate 

questions being raised deal with the relevant 
significance of what happened to children In a 

project Ihe President and the Congress are 

asking what really does happen to those who 
participate in compensatory education programs 
and they are making decisions on the basis of the 
answers to this question." 



SOME WAYS OUT OF THE BIND 

"If the ultimate questions being raised in the 
'terminal evaluation' of programs are going to 
deal with the long-range, relevant significance of 
the programs, then questions such as 'how well 
do Title I youngsters from a preschool program 
do one, two, and th ree years after?' have to be 
taken into account in the design of objectives and 
services for the preschool program. In other 
words, in planning and designing a project, edu- 
cators must take into consideration the immedi- 
ate and long-range effects for which they may 
finally be held accountable." 
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Accountability And The Future 
For Compensatory Education 



i 




Dr. Elaine C. Davis, Director of the Model Cities 
and Pilot Schools project with Baltimore City 
Public Schools, summarized some of the recom- 
mendations made by partkipants during the 
conference work sessions. Among these recom- 
mendations were calls for: 

• More parent and community involvement, us- 
inga team approach, in compensatory educa- 
tion programs. 

• More publicity for Title I, to inform parents, 
teachers, administrators, budget bureaus, poli- 
ticians and legislators of the Title I philosophy 
and of what Title I aims to iccomplish. 

• A handbook and/or training sessions, devel- 
oped by the State Depaiiment of Education, to 

'• help districts write projects. 

Developing objectives. 

Defining "hard line data." 

Developing instruments other than standard- 
ized tests to evaluate areas besides academic 
achievement. 

Clarifying how "evaluation" differs from 
"measurement." 

f $ : J Developing techniques for assessing com- 
munity needs. 

Clarifying requirements for evaluation: Are 
Informal test results, teacher judgment and/or 
V anecdotal records acceptable? 




• Conferences, arranged by the State Department 
of Education, to acquaint LEA personnel with 
techniques for teaching Title I children. 

• A pooling of State resources to aid smaller 
counties. 

• A conference, planned and conducted by par- 
ents of Title I children, to which educators are 
invited. 

• A compilation of all local projects for distribu- 
tion to all LEA's. 

• A compilation of references on topics such as 
objectives and evaluative ineasures. 

• A more reasonable schedule for reports re- 
quired of LEA's by the State. 

• More humanism in projects written by local 
districts. 

Concern was expressed over whe’her chil- 
dren's needs were being lost sight of in 
writing programs to satisfy regulations. 

• Inservice opportunities for the team present 

from each LEA at the conference to work In 
their district with teachers, administrators, 
parents, and aides. ' 

• Inservice education for teachers in focal dis- 
tricts to improve attitudes toward Title l chil- 
dren and expectations of their achievement 

• More political orientation on the part of 
educators. 

Teachers should be permitted to help write 
legislation on education at both the State 
and federal levels. 








TESTING PROGRAMS FOR ACCOUNTABILITY 

"Federal regulations require objective measure- 
ment of educational achievement on an annual 

basis The tests must be given annually — not 

specially designed tests — but those which will 
give the child a realistic view of how society will 
judge him. . . . Accept this both intellectually 

and practically and plan accordingly Read 

the test manuals carefully and conduct an item 
analysis of tests used to determine what the tests 
are all about and to know what is required of the 
children besides right and wrong answers. . . . 
Provide the children during the school year with 
activities of the types required in the test. . . . 
Develop informal tests that require the same 
types of test performance " 

"In planning an informal testing program, use the 
following questions as a guide: 

• How often do teachers measure achievement 
in reading? 

• How is the next reading ievel determined? 

By the 'completion' of the current book in the 
basal reading series? By the principal or super- 
visor who says 'Group X has been on Book Y 
long enough . . . move to the next level'? 

Or by some more objective measure? 

• How often is a child's reading difficulty diag- 
nosed for the skills required to overcome tne 
difficulty? Is each of ’he necessary skills taught 
and then the pupil's achievement measured as 
steps In overcoming the difficulty? 



• If tests are 'culturally biased/ how are pro- 
grams designed to overcome these cultural dif- 
ferences? Are cultural trips planned simply to 
increase knowledge about cultural centers and 
resources in the community, or simply to pro- 
vide background for language experiences?" 




TO IMPROVE ACCOUNTABILITY 
FOR TIME 

SPENT IN THE CLASSROOM 



"We are In an age of technological wonders, but 
educationally we are still operating at a horse- 
and-buggy level. The basic tools In education 
even today are an overly loquacious teacher and 
a book. . . . What else can you use to point 
toward Improved performance? 





"Regardless of the similarity between two chil- 
dren's test scores, the chances are that each child 
learns differently. Could you, by treating them 
differently, make a difference? Could you in- 
crease your repertoire of teaching techniques and 
your tools to make a difference? Do you really 
try to Individualize instruction? 

"Do you know the children of today or do you 
think of them as you did before T.V.? Children 
today are more sophisticated, more intelligent, 
more experienced than ever before in history. 
They learn enormous amounts without our inter- 
ference Children, now more than ever, have 

more freedom, are more independent in some 
respects, are more critical, have more Ideas, have 
more bases on which to arrive at decisions, and 

they make some good ones Capitalize on the 

children's strengths and let them make some de- 
cisions that affect their learning." 

"To improve reading, children must read, but 
why must they learn to read by reading what we 
select for them? . . . Reading materials are not 
confined to books or to classroom collections or 
to school libraries. If children know that what 




they really want to read is in the public library 
or on the paperback racks in the drugstore, or at 
the newsstand, they'll try to read these things and 
be anxious to learn to read better in order to read 
them. 

". . . find new ways to use the school staff. . . . 
Can the staff be redeployed by means of team 
teaching? Or departmentalization? Or ungraded 
school organization? Or by other means?" 



ACCOUNTABILITY THROUGH PROJECT 
PLANNING AND EVALUATION 

"How are proposals for annual funding devel- 
oped? Annually, on a year-to-year basis? Or are 
they developed annually, but as a result of long- 
range planning? Do you look ahead three or five 
years and submit your annual proposal as a step 
toward the long-range goals? Do you re-evaluate 
the long-range goals as a result of yearly evalu- 
ations and restate them before the annual pro- 
posal is prepared? 

"Do you ask yourself what you would really 
like to know about the children in the program 
at the end of one, two, three, five years? Do you 
then collect sufficient data each year so that a 
longitudinal study is possible, if you decide, after 
the program is underway, that this is what you 
want to do? 

"Are teachers involved in planning? Are their 
practical experiences taken into account? Are 
they aware of what research says is and is not 
effective? If so, what do you and they do to use 
this knowledge? 

"You are continually evaluating children. How 
often do you evaluate yourself?" 





TO MAKE A DIFFERENCE... 



"You must plan to go beyond the requirements 
established by federal regulations. These regula- 
tions ask only that there be a . . . statistically sig- 
nificant difference. You are professionally and 
morally committed to attempt to secure educa- 
tionally and relevantly significant results. Indi- 
viduals must be more than functionally literate, 
as children's achievement must be relevant to the 
needs of society and their function in it." 





Steps Toward Accountability 




Afterword 




The conference. Accountability: Evaluating Com- 
pensatory Education, was Intended to stimulate 
exchanges of Ideas and self-examina;ion. Judging 
from the comments submitted by participants, the 
conference succeeded In doing this, in addition, 
several key concepts seemed to emerge as con- 
tinuous themes throughout the conference — 
themes which should be taken into consideration 
in the design of any ESEA Title I program of 
compensatory education: 



. A comprehensive assessment of the needs of 
the educationally disadvantaged is essential In 
p r eparing a Title I project. This assessment 
should be based on formal and informal test 
ing data; on parents' and the community's ex- 
pressions of concerns; on diagnoses of the 
physical, social, emotional, and psychological 
state of the children; and on the observations 
of school personnel. 



1. Ba'ic academic skills, with an emphasis on 
mading/language arts must be the focus of 
Title I programs. 






ERIC 






2. The trend In compensatory education programs 
for the disadvantaged is toward prevention of 
problems and the development of educational 
retdirms In the earliest childhood years, rather 
than remediation of long-entrenched problems 
U In later grades. „ 



A. The key to meaningful evaluation and to ful- 
filling the responsibility for accountability Is in 
the statement of the project's objectives. 

a. Objectives should be limited In number. 

b. Objectives, or the desired outcomes of the 
project, should be :tated in clear, simple, 
measurab/e terms. 

c. Objectives should be determined by and 
directly related to the assessed neeas of 
students. 



j 




5. If a project's objectives reflect each of the 
preceding basic characteristics, the types of 
services and instructional activities that should 
be providtd will be clear. 

6. The evaluation instruments to be used to mea- 
sure the effects of the project should be ex- 
pressfy and specifically related to the stated 
objectives and activities of a project. Instru- 
ments used in posttesting should be para’H 
forms of the instruments used in pretesting, so 
that measurement of progress may be mean- 
ingful. 



It is tempting to side-step the responsibility for 
accountability through statements of all-encom- j 
parsing, vague goals; through broad or unfocused 
instructional programs; and through Inadequate 1 
evaluation designs, unrelated to pioject objectives 
and services. But the day is past when educators 
can maJc ineffectiveness by such evasive tactics. 

We have entered the age of accountability, and 
educators are being held accountable for whether 
or not students lea, n and achieve. 
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